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Abstract 

We present a thermodynamic formulation for scale- invariant systems based 
on the minimization with constraints of Fisher's information measure. In 
such a way a clear analogy between these systems's thermal properties and 
those of gases and fluids is seen to emerge in natural fashion. We focus 
attention on the non-interacting scenario, speaking thus of scale-free ideal 
gases (SFIGs) and present some empirical evidences regarding such disparate 
systems as electoral results, city populations and total citations in Physics 
journals, that seem to indicate that SFIGs do exist. We also illustrate the 
way in which Zipf 's law can be understood in a thermodynamical context as 
the surface of a finite system. Finally, we derive an equivalent microscopic 
description of our systems which totally agrees with previous numerical sim- 
ulations found in the literature. 
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1. Introduction 

Scale- invariant phenomena are rather abundant in Nature and display 
somewhat unexpected features. Examples can be found that range from 
physical and biological to technological and social sciences [lj]. One may 
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cite, among many possibilities, that empirical data from percolation theory 
and nuclear multifragmentation [2| reflect scale-invariant behaviour, as does 
the abundance of genes in various organisms and tissues [3]. Additionally, 
we can speak of the frequency of words in natural languages [ij], scientific 
collaboration networks the Internet traffic 0], Linux packages links [zj], 
as well as of electoral results 0], urban agglomerations 10, 11] and firm 



sizes all over the world 12j. What characterizes these disparate systems is 
the lack of a characteristic size, length or frequency for an observable k under 
scrutiny. This fact usually leads to a power law distribution p(k), valid in 
most of the domain of definition of k, 

p(k) ~ l/k 1+ \ (1) 

with 7 > 0. Special attention deserves the class of universality defined by 
7 = 1, which corresponds to the so-called Zipf's law in the cumulative dis- 
tribution or the rank-size distribution 0, SUB, 0, 0, 11, 12, 13]. Recently, 



Maillart et al. 0] have found that links' distributions follow Zipf's law as a 
consequence of stochastic proportional growth. In its simplest formulation 
such kind of growth assumes that an element of the system becomes en- 
larged proportionally to its size k, being governed by a Wiener process. The 
class 7 = 1 emerges from the condition of stationarity, i.e., when the system 
reaches a dynamic equilibrium [lij]. We will as well propose to consider the 
case 7 = as representative of a second class of universality, since the en- 
suing behavior, empirically found by Costa Filho et al. [§j with regards to 
the vote-distribution in Brazilian electoral results, emerges as the result of 
multiplicative processes in complex networks 

In this paper we attempt to formulate a thermodynamic treatment com- 
mon to these systems. Our efforts are based on the minimization with appro- 
priate constraints of Fisher's information measure (FIM), abbreviated as the 



MFI approach. It is shown in [14| that MFI leads to a (real) Schreodinger- 
like equation whose "potential" function is given by the constraints employed 
to constrain the variational process. The interplay between constraints and 



associated Lagrange multipliers turns our to be Legendre-invariant [14| and 
leads to all known thermodynamic relations. Such result constitutes the es- 
sential ingredient of our considerations here. We will first consider the MFI 
treatment of the ideal gas (Seccion 3), not given elsewhere as far as we are 
aware of, since it is indispensable to deal with it in order to fully understand 
the methodology employed for scale-free systems, which is tackled in Section 
4. Applicatioms are discussed in Section 5 and some conclusiones drawn in 
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Section 6. We begin our considerations in Section 2 with a brief Fisher's 
sketch. 



2. Minimum Fisher Information approach (MFI) 

The Fisher information measure I for a system described by a set of 
coordinates q and physical parameters 6, has the form [l5| 



1(F) = I rfqF(q|^)^c JJ J-lnF(q|^)J-lnF(q|0), (2) 

where F(q\8) is the density distribution in a configuration space (q) of vol- 
ume Q conditioned by the physical parameters collectively represented by 
the variable 9. The constants Cy account for dimensionality, and take the 
form Qj = CjS ij if qi and qj are uncorrelated, where 5ij is the Kronecker delta. 



As shown in [141 ] . the thermal-equilibrium state of the system can be deter- 
mined by minimizing / subject to adequate prior conditions (MFI), like the 
normalization of F or by any constraint on the mean value of an observable 
(Ai) [14]. The MFI is then cast as a variation problem of the form 

8^(F)-J2»Mi)\=0, (3) 
where /ij are appropriate Lagrange multipliers. 



3. MFI treatment of the ideal gas 

As a didactic introductory example, not discussed in [HI, we will here 
rederive, via MFI (something original as far as we know), the density dis- 
tribution, in configuration space, of the (translational invariant) ideal gas 
(IG) [l6|, that describes non- interacting classical particles of mass m with 
coordinates q = (r,p), where mdr/dt = p. The translational invariance is 
described by the translational family of distributions F(r, p\9 r , 9 P ) = F(r', p') 
whose form does not change under the transformations r' = r — 9 r and 
p' = p — 9 p . We assume that these coordinates are canonical [TtJ and un- 
correlated. This assumption is introduced into the information measure ([2]) 
setting Qj = c^-, where q = c r for space coordinates, q = c p for mo- 
mentum coordinates. The density can obviously be factorized in the fashion 
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F(r,p) = p(r)i](p), and then 15( it follows from the additivity of the infor- 
mation measure that I = I r + I p . If D is the dimensionality we have 



I r = c r d D r p(r) |V r lnp(r)| 2 

7 2 (4) 

c p / d D p rj(p) |Vplnr?(p)| 2 . 



In extremizing FIM we constrain the normalization of p(r) and i](p) to 
the total number of particles N and to 1, respectively, i.e., 

J d D r p(r) = N, J d D p rj(p) = 1. (5) 

In addition, we penalize infinite values for the particle momentum with a 
constraint on the variance of ^(p) to a given empirically obtained value, 
namely, 

J d D p V {p)(p-pf = Dal ( 6 ) 

where p is the mean value of p. For each degree of freedom it is known 
from the Virial Theorem that the variance is related to the temperature T 
as <Tp = rnksT with ks the Boltzmann constant. Variation thus yields 



5|c r y d u r p|V r lnpr + /x J d u r pj = (7) 

and 

5^c p j d D pri\\7 p ln V \ 2 + \ j d D p rj(p - p) 2 + u J d D p r\ =0, (8) 
where p, A and v are Lagrange multipliers. Introducing now p(r) = ty 2 (r) and 



varying ([7]) with respect to \l/ leads to a Schroedinger-like equation [14j, [18 



[-4V 2 + /i']vI/(r) = 0, (9) 

where p' = p/c r . To fix the boundary conditions, we first assume that 
the N particles are confined in a box of volume V, and next we take the 
thermodynamic limit N, V — > oo with N/V finite. The equilibrium state 
compatible with this limit corresponds to the ground state solution (// = 0), 
which is the uniform density p(r) = N/V. 
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Introducing 77 (p) = $ 2 (p) and varying (jSj) with respect to $ leads to the 
quantum harmonic oscillator-like equation [18] 

[-4Vj + A'( P -p) 2 + ^]<f(p) = 0, (10) 

where A' = X/c p and v' = vjc v . The equilibrium configuration corresponds 
to the ground state solution, which is now a gaussian distribution. Using (jBJ) 
to identify |A'| -1 / 2 = a 2 we get the Maxwell-Boltzmann distribution, which 
leads to a density distribution in configuration space of the form 

If H is the elementary volume in phase space, the total number of microstates 
is Z = N\H DN YliLi -^i( r «) Pi); where Fi — F/N is the monoparticular distri- 
bution and N\ counts all possible permutations for distinguishable particles. 
The entropy S = —ks InZ gets then written in the form 




^^{MVJ + — /• (12) 

where we have used the Stirling approximation for N\. This expression 



agrees, of course with the known value entropic expression for the IG 16], 
illustrating on the predictive power of the MFI formulation advanced in 14]. 



4. Scale invariant systems 

We pass now to the leit-motif of the present communication and con- 
sider a one-dimensional system with dynamical coordinates q = (k, v) where 
dk/dr = v, with r the time variable. We define k as a discrete coordinate, 
i.e. k = k±, k 2 , . . . , where ki = iAk and M ^> 1, is the total number 
of bins of width Ak in our system. In order to address the scale-invariance 
behaviour of k we change variables passing to new coordinates u — Ink and 
w = du/dt. We work under the hypothesis that u and w are canonically 
conjugated [17] and uncorrelated. This assumption immediately leads to 
proportional growth since 

dk/dt = v = kw. (13) 
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For constant w this equation yields an exponential growth k = koe wt , which 
represents uniform linear motion in u, that is, u = wt + u^, with Uq = In & (li- 
lt is easy to check that the scale transformation k' = k/8k leaves invariant 
the coordinate w, whereas the coordinate u transforms translationally as 
u' = u — Qk, where 9^ = ln^. Thus, the physics does not depend on scale 
and the system is translationally invariant with respect to the coordinates u 
and w, entailing that the distribution of physical elements can be described 
by the monoparametric translation families f(u, w\Qk, Q w ) = f(u',w'). By 
analogy with the IG, we will call our system a "scale- free ideal gas" (SFIG), 
i.e., a system of N non- interacting elements. Taking into account that i) u 
and w are canonical and uncorrelated (cu = q ^ and c uw = c wu = 0), so 
the density distribution can be factorized as f(u, w) = g(u)h(w), and ii) that 
the Jacobian for our change of variables is dkdv = e 2u dudw, the information 
measure I = I u + I w can be obtained in the continuous limit as 



I u = c u du e 2u g(u) 
Jn 



Iw — c w dw h{w) 



d\n.g{u) 



du 
d In h(w 



dw 



(14) 



where Q = ln(/cM/^i) = InM is the volume defined in 



"w"-space. 



4-1. MFI treatment of the scale- free ideal gas 

The constraints to the given observables (A4) in the extremization prob- 
lem determine the behaviour of the system. For the general case, we constrain 
the normalization of g(u) and h(w) to the total number of particles N and 
to 1, respectively 



du e 2u g(u) = N, 



n 



dw h(w) 



(15) 



In addition, we penalize infinite values for w with a constraint on the variance 
of h{w) to a given measured value 



dw h{w){w — w) 



o~„. 



(16) 



1 This exponential growth allows to idcntif^the systems that we study in this work in 
macroscopic fashion with those addressed in [19( . 
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where w is the average growth. The variation yields 



5 { c u J du e u g 



ding 



du 



p j du eg 



(17) 




dw h 



dlnh 



dw 



/oo /*oo f 

dw h(w -wf + v I dw h \ = 0, (18) 
-oo J —oo J 



where p, A and v are Lagrange multipliers. Introducing g{u) 



-2u 



and varying (fTTj) with respect to \l/ leads, as is always the case with the MFI 



14j, to the Schroedinger-like equation 



- 4 |i + 4H V 



V(u) = 0, 



(19) 



where /i' = fi/c u . Analogously to the IG, we impose solutions compatible 
with a finite normalization of g in the thermodynamic limit iV, £7 ^ oo 
with N/Q = po finite, where po is defined as the bulk density. Solutions 
compatible with the normalization of ffT5l) are given by ^(w) = A a e~ au ^ 2 , 
where A a is the normalization constant and a = a/4 + p' . In this general 
case, the density distribution as a function of k takes the form of a power 
law: g a (lnk) = A 2 /k 2+a . The equilibrium is always defined for the MFI as 
the ground state solution [l3], which corresponds to the lowest allowed value 
a = 0. 

Introducing now h(w) = $ 2 (w) and varying ffl8l) with respect to $ leads 



to the quantum harmonic oscillator-like equation [14], [18 



-4- 



+ X'(w - w) 2 + v' 



$(w) = 0, 



(20) 



where A' = X/c w and v' = vjc w . The equilibrium configuration corresponds 
to the ground state solution, which is now a Gaussian distribution. Using (fl6l) 
to identify |A'| -1 / 2 = we get the Maxwell-Boltzmann distribution 



h(w) 



exp 



[w 



wf/2al 



(21) 
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The density distribution in configuration space F(k, v)dkdv = f(u, w)e 2u dudw 
is then 

^,,)4 gH!wa , (22) 

If we define H = Ak 2 /Ar as the elementary volume in phase space, where At 
is the time element, the total number of microstates is Z = N\H N YliLi F\{k^ Vi), 
where F\ = F/N is the monoparticular distribution function and N\ counts 
all possible permutations for distinguishable elements. The entropy equation 
of state S = —ulnZ reads 




S = NKnn-^—^ + - }, (23) 



where k is a constant that accounts for dimensionality and H' = H/ (/cm^i) = 
H/(MAk 2 ) = l/(MAr). Remarkably, this expression has the same form as 
the one-dimensional IG (D — 1 in f|T2l ); instead of the thermodynamical 
variables (N,V,T), here we deal with the variables (N,Q,a w ), which make 
the entropy scale-invariant as well. 

The total density distribution for k is obtained integrating for all v the 
density distribution in configuration space. Accordingly, from fl22l) we get 

F(k) = j dvF(k,v) = ~ = ^. (24) 

It can be shown that this it is just a uniform density-distribution in u-space 
of the bulk density: F(k)dk = f(u)e u du = N/Qdu = p$du. 



5. Social examples of scale-free ideal gases 



A common representation of empirical data is the so-called rank-plot or 
Zipf plot jl, [HI 2(|, where the jth element of the system is represented by 
its size, length or frequency kj against its rank, sorted from the largest to the 
smallest one. This process just renders the inverse function of the ensuing 
cumulative distribution, normalized to the number of elements. We call r 
the rank that ranges from 1 to N. For large N, the density distribution fl2T 
correspond to an exponential rank-size distribution 



k(r) = &Mexp 



(25) 
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Figure 1: (colour on-line) a, rank-size distribution of the cities of the province of Huclva, 
Spain (2008), sorted from largest to smallest, compared with the result of a simulation 
with Brownian walkers (green squares), b, rank-plot of the 2008 General Elections results 
in Spain, c, rank-plot of the 2005 General Elections results in the United Kingdom. (Red 
dots: empirical data; blue lines: fit to (f25j) ). 



This behaviour, which corresponds to the class of universality 7 = 
in ([1]), is that empirically found by Costa Filho et al. [8| in the distribution 
of votes in the Brazilian electoral results. We have found such a behaviour 



9 



-0.04 



-0.08 




— Maxwell-Boltzmann 
• Empirical 

Random Walkers 



30 40 50 

Rank 



Figure 2: (colour on-line) Rank-plot of the growth rate w of the province of Huelva between 
2007 and 2008 (red dots) compared with a Boltzmann distribution with the same mean 
value and standard deviation (blue line). 



in i) the city-size distribution of small regions (as in the province of Huelva 
(Spain) jilj]) and ii) electoral results (as in the 2008 Spanish General Elec- 
tions results (ii|). We depict in figures la and lb the pertinent rank-sizes 
distributions in semi-logarithmic scale, where a straight line corresponds to 
a distribution of type (1231) . A large portion of the distributions can be fitted 
to (1231) . with a correlation coefficient of 0.994 and 0.998, respectively. From 
these fits we have obtain a bulk density of po — 0.058 for the General Elec- 
tions results, and in the case of Huelva of po = 17.1 (N = 77, Q = 4.5). Using 



historical data for the later 21 , we have used the backward differentiation 



formula to calculate the relative growth rate of the i-th city as 

lntf 0081 -lrife! 2 ™" , , 

«. = At (26) 

where kf 007 ^ and k^ 2008 ^ are the number of inhabitants of the i-th city in 
2007 and 2008, respectively while At = 1 year. We show in figure [2] the 
empirical rank-plot of the relative growth, where we have obtained W = 
0.011 years -1 and a w = 0.030 years -1 , compared with the rank-plot of a 
Maxwell-Boltzmann distribution with the same mean value and standard 
deviation. 

However, these regularities are not always obvious to the naked eye, as 
shown for the case of the most voted parties in Spain'08 or for the whole 



distribution of the 2005 General Elections results in the United Kingdom 23 



(figure lc). In both cases, the competition between parties seems to play 
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an important role, and the assumption of non-interacting elements can be 
unrealistic 0. 



5.1. Bulk and Zipf regimes 

The situation in which N/Q — > constant 7^ as N, Q —>■ 00 will be 
referred to herefrom as the bulk regime. Now, in a recent communication 
(iil . we show that Zipf's law (7 = 1 in ([T]) with a slope of —1 in the rank- 
plot) can be derived from the extremization of Fisher's information with 
no constraints. In the thermodynamic context studied here, the absence of 
normalization can be understood as the inability of the system to reach the 
thermodynamic limit, i.e. N/Q — > as N, Q — > 00. In this case the system 
can not follow (j24p . Zipf's law emerges as this behaviour of the density in 
what we will accordingly denominate the Zipf regime (N/Q — > 0). We digress 
on the conditions for both regimes in the example discussed below. 

We have studied the system formed by all Physics journals [26| (N = 
310) using their total number of cites as coordinate k. If a journal receives 
more cites due to its popularity, it becomes even more popular and therefore 
it will receive more cites. Under such conditions proportional growth and 
scale invariance are expected. Since we consider all sub-fields of Physics, 
correlation effects are much lower than they would be should we only consider 
journals pertaining to an specific sub-field. Accordingly, the non-interacting 
approximation seems to be realistic in this instance. In figure 3 we depict 
the rank-plot of the number of citations in Physic journals, and find a slope 
approaching —1 for the most-cited journals in the logarithmic representation 
(figure 3a) and an slope in the vicinity of r +1 for the less-cited journals 
(figure 3b). For the central part of the distribution, the bulk density reaches 
a value of p ~ 57 (figure 3c). 

This distribution shows a notably symmetric behaviour under the change 
k — > 1/k (u — > —u). We exhibit in figure 4 the raw empirical data as 
compared with the distribution obtained from the transformation k! = c/k 
(u' = —u + lnc), where c = 3.3 x 10 6 . The main part of the density distribu- 
tion reaches the bulk density obeying (1241) . whereas Zipf's law emerges at the 
edges, which could be understood as constituting the surface of the system, 
since they explain how the density (exponentially) falls from its bulk-value 



2r 



The effects of interaction are studied in 24] , where we go beyond the non-interacting 



system using a microscopic description based on complex networks. 
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Figure 3: (colour on-line) a, rank-plot of the total number of cites of physics journal, from 
most-cited to less-cited, in logarithm scale, b, sorted from less-cited to most cited c, same 
as a, in semi-logarithm scale. (Red dots: empirical data; blue line: fit to l|25[)). 



to zero in w-space when the system is exposed to an infinitely empty vol- 
ume. This effect is clearly visible in figure 5, where the empirical density 
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Figure 4: (colour online) Rank-plot of the total number of cites of Physics journal, from 
most-cited to less-cited, compared with the distribution obtained from the inverse trans- 
formation k' — 3.3 x 10 6 /k where k is the number of cites. 




Figure 5: (colour online) Empirical density distribution in u-space of the total number of 
cites of Physics journals, compared with (|27[) . The bulk regime and the Zipf regime at the 
edges is clearly visible. 



distribution p(u)du in u-space is compared with the "fitted" density 

{p z e u ~ ui if u < u\ 
p if u\ < u < u 2 (27) 

p z e U2 ~ u if u > 2 

where pz = 18, po = 57, U\ = 5.2 and u% = 10. These findings lead us 
to conclude that the system consisting of Physics journals, when sorted by 
total number of citations, is a perfect example of a finite scale-free ideal gas 
at equilibrium. 
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5.2. An accompanying microscopic description 

The dynamics of the system under scrutiny here can be microscopically 
described as a stochastic process using (fT3|) together with the density dis- 
tribution (l2Tj) . Treating w as a random variable, the pertinent stochastic 
equation of motion is written in the guise of a geometrical Brownian motion, 



i.e., 
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alk = kwdt + ka w dW, (28) 
where dW represents a Wiener process. In the u-space, this equation reads 

du = wdt + a w dW, (29) 

and is known to describe the celebrated Brownian motion ( l28l) . which ex- 
actly describes the dynamical condition found empirically in [7j and also the 



(stochastic) proportional growth model used in [13] to obtain Zipf 's law. We 
thus dare to suggest that we are dealing here with a sort of "equivalent" of 
a molecular dynamics' simulation for gases/liquids (27| . 

Indeed, (1291) describes N Brownian walkers moving in a fixed volume Q 
with uniform density in w-space, a model used in the literature to describe 
the ideal gas [27[ . This scenario can also be reproduced by our free-scale ideal 
gas merely by choosing to represent the system with the coordinates (k,v). 
In figure la we show the rank-plot for k of a system of iV = 78 geometrical 
Brownian walkers with W = 0.011 and a w = 0.030 in a volume Q = 4.5, with 
d k\ = 200 in reduced units, which approximately describes the distribution 
of the population of the province of Huelva. We also show in figure 2 the 
rankplot of w of the same random walkers, compared with the empirical data. 



6. Conclusions 



Our present considerations derive from the fact that, as shown in [14 
thermodynamics can be reformulated in terms of the minimization with ap- 
propriate constraints of Fisher's information. We have applied such refor- 
mulation in order to discuss the thermodynamics of scale-free systems and 
derived the density distribution in configuration space and the entropic ex- 
pression for the equilibrium state of what we call SFIG: the scale-free ideal 
gas (in the thermodynamic limit). We have encountered convincing empir- 
ical evidences of the SFIG actual existence in sociological scenarios. Thus, 
we have dealt with city populations, electoral results and citations in Physics 
journals. In such a context it is seen that Zipf's law emerges naturally as 
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the equilibrium density of the non-interacting system when the volume grows 
without bounds, a situation that we call the Zipf regime. Using empirical 
data we have revealed that this regime can be understood as a density-decay 
at the "surface" separating the bulk from an empty and very large volume. 
Finally, we have shown with a simulation of city-populations that geometrical 
Brownian motion can describe such systems at a microscopic level. 
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